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mine the value of tests in predicting 
academic or vocational success. The 
results of most of these studies are 
dubious because of the operation of 
веесНоп 5 The research reported 
by Emmett is unique in that techniques 
are applied which yield estimates of the 
regression coefficients, their standard 
errors, and the correlations which would 
be obtained had selection not operated. 
..... This scholarly iittle monograph 
should be “required reading” for all 
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regression equations in the prediction 
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PREFACE 


Mn. W. С. Емметт has been away on national service 
since the spring of 1940 and has been therefore unable 
to see this little book through the press himself. It 
has been a pleasure to his colleagues at Moray House 
to do this for him, and they accept all responsibility 
for any misprints overlooked, or the like. As the whole 
description of the inquiry is necessarily and advisedly 
somewhat long and detailed, I have thought it wise to 
give the following short summary in this preface, to 
assist the reader. 

The 765 children who were the subjects of the 
inquiry were the survivors of a larger number of 
entrants, who had remained for three years in certain 
West Riding secondary schools, and included both 
special-placers and fee-payers, children who had been 
handicapped by illness or other special influence being 
alone excluded. They were assessed by the schools 
after two and again after three years, and these assess- 
ments were correlated with the examinations which 
all had sat before entrance. The data included— 


ху = Rank in secondary-school assessment. 


X = Intelligence quotient буйн 
а Б q n at examination before 


ха = English score 
entrance. 


x, = Arithmetic scare 


The candidates at the entrance examinations were all 
drawn from one year-group. The intelligence quo- 
tient was found from a Moray House test, lasting 40 
minutes. ‘The English and Arithmetic examinations, 
lasting 65 and 55 minutes respectively, were set by, 
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and marked under the guidance of, two experienced 
examiners whose methods have been much influenced 
by new type forms of test, and one of whom is a 
competent practical statistician. 

The statistical difficulties of combining data from 
several schools were met by methods which are 
explained in the article. The correlations of the 
secondary-school assessment with the three parts of 
the entrance examination are shown in this table (not 
the values in brackets, which are explained below): 


Assessment with After 2 years After 3 years 
LO. ^s — 442 (719) 454 (736) 
English — Туз "323 (683) :335 (702) 
Arithmetic ТТА :304 (671) :330 (:694) 


These correlations, being in a very highly selected 
group with shrunken standard deviations, are consider- 
ably smaller than correlations would be in the whole 
population of children from, whom these 765 are 
drawn. To compare different experiments and to 
judge the actual closeness of association it is necessary 
to correct them to the values the correlations would 
have in the complete population, for which purpose 
we require the standard deviations and the intercorre- 
lations of л», хз and x4, the three parts of the entrance 
examination, both in the whole population and in this 
ш of 765. These are given in the following 
table : 


In the sample In the population 


Sy 9:67 15:00 
EO 12377 2344 
Л 16-01 25-89 
Тэз 437 :833 
724 1357 “Вод 


754 “194 -769 
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The correlations which secondary-school assessment 
would have with x5, xg and x, if the whole population 
of children had been thus assessed can then be cal- 
culated by Karl Pearson's formule, preferably in 
Aitken's matrix formulation, and are given in brackets 
in the table already printed earlier. The smaller 
. coefficients, those not in brackets, are the actual 
correlations found in this sample of 765 highly selected 
children. They indicate the extent to which changes 
in the order of merit of these 765 children take place. 
But in deciding whether the entrance examination 
has in a general sense chosen the right children to 
enjoy secondary-school education it is the larger corre- 
lations, those in the brackets, which should be used, 
which refer to the whole population of children of 
which those 765 are a sample. In a similar way the 
order of merit among First League football clubs may, 
if they are well chosen and equally matched, change 
violently during a season, and yet perhaps most of the 
First League teams could beat any Second or Third 
League team. Correlations among the First Leaguers 
would be low, those among al} teams high, and it would 
be the latter which would indicate that the right 
teams were in the First League. 

Another reason for using the correlations as esti- 
mated in the whole population in comparing the parts 
of the entrance examination is that since English and 
Arithmetic were in the years in question in the West 
Riding the dominating grounds of selection (the 
intelligence test being only used near the border-line), 
their standard deviations are somewhat more shrunken 
than that of the intelligence test. (The ratios of 
shrinkage are in fact -645 for І.О., :545 for English, 
:618 for Arithmetic.) In consequence of this the 
correlation coefficients in the sample will, to a slight 
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degree, unduly favour the intelligence test; but this 
bias disappears in the estimated correlations for the 
whole population, in which it will be seen that the 
І.О. has only a small lead on English or Arithmetic, 
which are equal. ‘The multiple correlation of the three 
together, with the later school assessment is -743 after 
two years, “764 after three. 

It is hoped that the appendices will be of practical 
value as a guide to workers wishing to make statistical 
computations like those used in this inquiry. Appen- 
dix 1 describes the calculation of regression coefficients 
and their standard errors. Appendix 2, on the influence 
of selection on the variance and covariances of the 
criterion, explains in detail, using the data of the 
present inquiry, Aitken’s method of calculation of 
Karl Pearson’s selection formule. The use of this 
technique in all follow-up inquiries would enable 
comparisons to be made independent of the shrinkage 
of range, due to selection, іп, the secondary schools. 
It is hoped that the present inquiry may form a model 
in this respect. Appendix 3 describes the calculation 
of the reciprocal of a matrix by Aitken’s method. 


Goprrey Н. Tuomson. 


CONTENTS 


INTRODUCTION . . . . . . 


. OUTLINE OF EXPERIMENTAL AND STATISTICAL 


PROCEDURE . . . . . . 


THE EXAMINATION АТ ENTRANCE TO SECONDARY 
SCHOOLS . . . . . . 


THE CHILDREN IN THE INQUIRY . . . 


THE CRITERION OF THE HEAD TEACHER'S ORDER 
OF MERIT . . . . . . 
THE INTERCORRELATIONS . . . . 


REGRESSION COEFFICIENTS AND THE PREDICTION 
OF THE CRITERION . . . . . 
THE INFLUENCE OF SELECTION . . . 


THE RELATIVE PREDICTIVE VALUES OF THE THREE 

EXAMINATION VARIABLES . . . . 
PARTIAL CORRELATION COEFFICIENTS . . 
DISCUSSION OF RESULTS . . . . 
SUMMARY . O . . . . 


APPENDIX I. THE CALCULATION OF REGRESSION 
COEFFICIENTS AND THEIR STANDARD ERRORS 


APPENDIX II. THE INFLUENCE OF SELECTION 
ON THE VARIANCE AND COVARIANCES OF THE 
CRITERION . б . . . . 


APPENDIX ШІ. THE CALCULATION OF THE RE- 
CIPRÓCAL OF A MATRIX BY PIVOTAL CON- 
DENSATION (AITKEN'S METHOD). 22 5 


9 


I2 


49 


25 


AN INQUIRY INTO THE PREDICTION OF 
SECONDARY-SCHOOL SUCCESS 


I. Іхтворостіох 

In 1935 ап investigation was undertaken in the 
West Riding of Yorkshire by the Education Officer, 
Dr. J. H. Hallam, to find out whether the scholarship 
examination for Special Places in secondary schools ` 
selected those children best fitted for secondary 
education. The co-operation of the Staff of the 
Education Department of the University of Edinburgh 
was enlisted in planning the procedure and in carrying 
out the statistical analysis of the resulting data. The 
preliminary results of the inquiry relating to the 
performance of entrants in 1933 after two years at the 
secondary school were reported by Professor Godfrey 
Н. Thomson in 1936! Since that time the statistics 
for these children after three school years, and for 
‘another year's entry after two and three years, havé 
come along. 

The present report combines the data collected at 
the different times. It is naturally the result of the 
collaboration of many people: the Education Officer 
of the West Riding, Dr. J. H. Hallam, and his successor, 
Mr. A. L. Binns, the staff of the Education Authority, 
and the head masters and head mistresses of the 
secondary schools; and in Edinburgh, Professor 
Godfrey Н. Thomson, Messrs. А. б. Rodger and А. 5. 
Mowat. 


1Godfrey, Н. Thomson, “The value of intelligence tests in an 
examination for selecting pupils for secondary education," B. y. Ed. 


Psych., 1936, 16, 174. 
F II 


‚ 
v. 
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The present writer is only responsible for the 
statistics of the later returns and for their combination 
with the earlier returns. Professor Thomson and Mr. 
D. N. Lawley have been constantly consulted over 
the statistical treatment, and many thanks are due to 
them for their kind assistance. ‘Thanks are also due 
to the Education Committee of the West Riding for 
their permission to publish the report. 


2. OurLINE or ExPERIMENTAL AND STATISTICAL 
РкосЕрокк i 

Scholarships to secondary schools were awarded on 
the results of a group verbal intelligence test, an Eng- 
lish paper and an Arithmetic paper. After the 
Successful candidates together with fee-payers had 
attended the secondary school for two years, they were 
arranged in order of merit by their head teachers SS 
further order of merit was drawn up after three years 
at the school. This procedure was followed for 
entrants in 1933 and 1934. 

The scores in each of the three parts of the entrance 
examination and the orders of merit were then 
correlated separately for each school and for each 
year’s entry.4 Corresponding correlation coefficients 
were then formed into weighted averages, giving final 
grids of coefficients showing the interrelation of the 
four variables. From these grids regression coefficients 
and multiple and partial correlations were calculated. 
The regression coefficients show the relative effective- 
ness of the three parts of the examination in predicting 
the criterion of the head teachers? assessments of the 
pupils. "The multiple correlation gives the highest 
attainable correlation of the examination as a whole 
with the criterion, each section of the examination 
receiving a weight proportional to its regression 
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coefficient. The partial correlations show the extent 
to which each section of the examination measures 
in the criterion what the other two sections do not 
themselves measure. 


3. Tur Examination AT ENTRANCE TO SECONDARY 
8сноо18 

Each of the examinations in 1933 and 1934 was held 
on a Saturday morning in the middle of February and 
was open to children of age between 10:0 and 11:11 on 
March 31st of the examination year. Candidates 
were selected by a preliminary internal test in English 
and Arithmetic set by the head teachers of the ele- 
mentary schools. Of the two-year field of children 
numbering 50,412 in 1933 and 47,312 in 1934, 26-3 per 
cent. and 26-8 per cent. respectively took the examina- 
tion. In 1933 2:5 per cent. of the field failed to sit, 
after recommendation as candidates: in 1934 the 
figure was 3:0 per cent. ‘The papers in each of the two 
years were, as stated above, an intelligence test, an 
English paper and an Arithmetic paper; questions in 
each subject were of closely similar type in both 
examinations. 

'The intelligence test, Moray House Test No. 17 in 
1933 and No. 19 in 1934, was constructed by the staff 
of the Education Department of the University of 
Edinburgh. It contained гоо questions of well-known 
types, such as analogies, classification, synonyms, 
antonyms, number series, proverbs and short problems. 
Answers were for the most part given by underlining 
the correct response out of several alternatives: 
writing was reduced to a minimum. А period of 40 
minutes was allowed for working, there being no inter- 
nal timing. The test was preceded by a practice test 
of eight questions, for which ten minutes were allowed ; 
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«pen 
the practice test was not marked. Norms were based 
on the scores of a background group of about 1,000 
children aged eight to fourteen years, together with the 
scores of a random sample of aout 1,000 candidates. 
Raw scores were converted їп intelligence quotients 
based on a mean quotient of 100 with standard devia- 
' tion of 15 for an unselected sample of population. 
'The I.Q. thus obtained may be regarded as a derived 
score which gives due allowance for age at all levels of 
ability. 

The English and Arithmetic papers were set by local 
examiners of wide experience under the auspices of a 
central examinations council. Marking was done bya 
team of about fifty assistant examiners, whose marks 
were adjusted to a common standard by the chief 

р examiners. Separate papers in each subject were set 
for the ro + children, “ Juniors” so-called, and for 
the 11 + or “ Seniors.” 

The English paper was of the usual type, the time 
allowed being 65 minutes ; it contained essay questions, 
requiring about half the allotted time. ‘The Arith- 
Metic paper occupied 55 minutes: its first part con- 
tained questions in which marks were given for accur- 
acy of working, while the second part was marked 
chiefly for good method and clear thinking. An age 
allowance of 1-2 per cent. per month of the maximum 
possible mark of 200 in the two subjects was given. 

Percentage frequencies for each score interval of ten 
points are given for the several papers in Table 1: 
these data are based оп representative groups of 
candidates, each numbering about 1,000. 

The mean raw scores given in Table 1 show that 
each paper taken as a whole was of a suitable order 
of difficulty. The scores in the two intelligence tests 
have a much smaller spread, as measured by the 
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3, ТАВІЕ 1 
SHOWING PERCENTAGE FREQUENCIES OF Raw SCORES OF CANDIDATES IN THE 
ADMISSION EXAMINATIONS 

(1) Scores are uncorrected for differences in age. 

(2) The maximum possible score in each paper was 100. 

(3) The scores are those of children from schools judged to be representative 
of the West Riding. 

(4) No intelligence test scores were available for the samples of Senior 
candidates. 


1933 EXAMINATION! 1934 EXAMINATION 
Juniors Seniors Juniors Seniors 
Score! (aged 10+) (aged 11+-) (aged 10+) (aged 11+) 
Interval | Intel, Intell. 


* | test |Engl|Arith.| Engl|Arith.| test | Engl.) Arith.| Engl.| Arith. 
M.H.T.|paper|paper |paper| paper |M.H.T.|paper|paper |paper|paper 


17 19 

9 | | 975 | 976 | 96 | 9 | “о | % | % | Vo 
90-100 OO ro| rg 0'2 | r4 оо 0:5 | 24 o8 | 14 
80-89 | o3 | 2:5 | 44 | 25127 | r3 | 33] 47 | 36] 51 
70-79 | 40 | 85 | 83 | 75] 83 | 53 | 99] 91 | 96] 73 
бо- бо | ir4 |15'8 [121 | 16-9 [128 | 12:5 | 14°8 [11:7 | 15-4 [114 
50- 59 | 28:8 | 19-7 | 18-3 |19:9 [15:5 | 24:4 | 18-9 [14:7 | 18-9 | 15-2 
40-49 |3rr | 19:7 [149 [204 [184 |293 | 19°6 | 17-4 | 19:2 |15:8 
зо- 39 | 20-4 [17:5 | 14:1 [19:2 |162 |:196 | 1774 | 14:9 |166 |16:5 
20- 29 34 8-8 [14:7 8-3 | 11:9 5'9 |10:4 | 11:2 97 [11:77 
10-19 | 00 | 54| 74 | 40| 80 | r4 | 45] 83 | 46] оо 
0- 9 оо 11 | 39 rı | 48 0-3 r6| 56 1:6 | 66 


Numberin 
sample | 943 | 943 | 943 [1064] 1064 | 1006 | 1006| 1006 | 994 | 994 
Meanraw M 
score | 48:08 | 48:12| 45°77 | 47°07] 44°57 | 47:88 | 47°82) 45:68 | 48:56, 43:93 
Standard 
deviation] 11:58 [17:91 | 21:24 | 16:89] 20°59 | 13:54 | 18:17] 22:18 | 18:50| 22:03 


standard deviation, than those of English and Arith- 
metic; that is to say, the intelligence tests have a 
smaller power of discrimination amongst the candi- 
dates. 'They obviously contain some questions too 
easy and some too difficult for the то + candidates. 
The tests were constructed primarily to differentiate 
over the whole range of ability of 11 + children ; very 
few children in the selected group of candidates may 
therefore be expected to make low scores, while few 
children may also be expected to make high scores on 
55 АЖ 
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account of their youth. It should be noted, however, 
that since 1934 the technique of test construction at 
Moray House has been considerably improved, and a 
recent test would give a much higher standard deviation 
of raw score from a similar sample of children. 

The first awards of scholarships were made to those 
children with highest scores in the English and 
Arithmetic papers only. For the border-line group 
the results of the intelligence test were also taken into 
account. The method of giving awards is, however, 
irrelevant to our present purpose; we are not con- 
cerned with how the children managed to get into a 
secondary school, whether by scholarship or payment 
of fees. We simply correlate their scores in the 


admission examination with estimates of their progress 
in the secondary school. 


4. Tue CHILDREN iN THE Іхоріку 


In the first instance returns were received in two 
successive years from ten secondary schools showing 
the orders of merit of the 1933 and 1934. entries after 
two years' schooling. Children who had been handi- 
capped by illness or other adverse circumstances were 
excluded from the survey. Later, similar returns 
came in from these schools with orders of merit after 
three years’ schooling. "Thé numbers of children in 
the latter returns were naturally less than those in the 
former on account of wastage; in some schools the 
numbers had dwindled so much that it was not con- 
sidered worth while to compute statistics for them. 


Ча 1933 апі 1934, the intelligence test was used as art adjunct to 
the English and Arithmetic papers by way of experiment. In 1935 
and later years the intelligence quotients were added to the English 


and Arithmetic scores, each equally weighted, for the determination 
of all awards. 


SS Аба 
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We thus had two series of statistics, one for assessments 
after two years, and one for assessments after three 
years, relating to different numbers of children, as 
follows : 


Assessed Assessed 
after 2 years | after 3 years 


1933 Entries 613 421 
1934 Entries 473 344 
"Total en 1086 765 


It was then decided to recalculate all the statistics 
for assessments after two years in respect of precisely 
those children, 765 in number, who were assessed after 
three years. In this way we obtained two sets of 
correlation coefficients which were equally influenced 
by selection and were therefore strictly comparable. 
This article relates only to the data from these 765 
children. 

Table 2 shows the distribution of the intelligence 
quotients of the children under review. Table 3 
shows the distribution of the children amongst the 
schools, according to year of entry and age group, 
1o-+or1r-+. ‘The standard deviation of І.О. shown 
in Table 2 is greater than that in Table 3, since the 


TABLE 2 


SHOWING THE DISTRIBUTION OF INTELLIGENCE QUOTIENTS OF THE CHILDREN 
IN THE INQUIRY 


2 ] 
Intelligence |85-(00-(05:1100-1105-1110-1115- 120-1125-1130- 135- 140-145: 


5 150- 
Quotient «80 |04 (09 |104 |109 |114 119 |124 |129 134 |139 [144 [149 


154 


Total 


Number: of | І | 
children 1214 27 | 46| 77 |149 162 [120 [101] 48| 12! 4] 765 


5 


Mean Т.О. = 126.21. Standard deviation of I.Q. = 10.02. 
The standard deviation has been corrected for grouping errors. 
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TABLE 3, SHOWING 


(1) The schools under survey. 

2) The number (N) of children in each school. 

3) The.mean I.Q. of such children. 

4) The standard deviation of their I.Q.'s about the school mean. 

5) The correlation between the head teacher's order of merit after two years 
and the order of merit after three years. 


School JUNIORS (1o-year-olds) Ѕеміовѕ (11-year-olds) 
(EE N | Mean бі Correlation | N | Mean б Correlation 
5 1.0. “9. | 2 yrs./3 years, 1.Q. | "-9:| 2 yrs./3 yrs. 
Entries, 1933 
2 18] 12079 | 10°37) *93 22| 117:9 [14:68] 86 
3 25| 129:2 | 6-92 “55 48| 121-7 | 9:97 :64 
4 36] 127:3 | 10:55 484 44|123:8 | 8-83 *66 
5 33| 12473 | 10°46) :88 -| — - = 
6 36| 126:6 | 10-10 77 48| 122°3 | 9:54 277, 
9° 27| 128-8 [10:74 +87 20| 125-8 | 9-18 70 
10 38| 130:2 | 9:83 76 26| 122:0 [12:25] 372. 
Totals and 
means 213|127:00| 9:88, *818 208| 122:31| 10-38] 721 
Entries, 1934 E 
2 5 zi | = 28| 128-1 | 9-48 KIO 
3 36] 129°5 | 10-92) 65 34| 127-0 | 6-86) “45 
4 38| 127-0 | 11-62 -67 32| 128-1 | 10:32. TZA 
6 53] 129:5 | 8-80 71 47| 1264 | 7:84 +78 
10 37| 127:5 | 7:36 75 39| 129:3 | 9:03 :83 
Totals and 
means 164| 128:47| 9:62 *699 180| 127:71| 8:57 1758 
Total number of children — 765 ‹ 
Means of all values in table. 1.Q. = 126-21 
Orig. — 9:67 


с ior ient = o: 
de orrelation Coefficient — 0:755 


(1) The means of the standard deviations have been obtained by taking the 


Square root of the averaged variances and applying Sheppard's correction for 
groupin 


(2) "The average of the correlation coefficients 1 i ined 
| by Fisher's z technique. cients is a weighted average obtai 


squared deviations in the former are taken about the 
general mean, while in the latter they are taken about 
the means of the respective schools. 1 

Boys formed 60-1 per cent. of the 421 entries іп 
1933, and 63:4 per cent. of the 344 entries in 1934. 
The Seniors or 11 + children include those who failed 
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to gain scholarships as ten-year-olds; they comprise 
roughly бо per cent. of the 11 + candidates. Of the 
Juniors 11 per cent. were fee-payers with mean I.Q. of 
116-3. Excluding these fee-payers the Juniors had a 
mean I.Q. of 129:29, and the Seniors, 126:97, with a 
mean for the combined groups (still excluding fee- 
payers) of 128:17. 


А rough check on this mean can be obtained from the per- 
centage of children in the total field receiving awards, which 
was about 8:5 per cent. in 1933 and 1934. If we assume that 
all children offered scholarships proceeded to the secondary 
school, and that the English and Arithmetic scores of these 
children, by which awards were made, correlated perfectly 
with their I.Q.’s, we should expect this mean І.О. to be 
127:5, this being the mean І.О. of the top 8.5 per cent. ofa 
normally distributed population with оо = 15. The agree- 
ment between the roughly estimated mean І.О. of 127-5 and 
the ascertained value of 128-17 is satisfactory, and substanti- 
ates the standardisation of the intelligence tests. 


5. Tue CRITERION or THE Heap TEACHERS ORDER 
or MERIT ; 

At the beginning of the investigation the head 
teachers of the secondary schools concerned were 
asked to rank in order of merit those children who 
entered their schools in 1933 and 1934, “ having 
regard to their performance in the normal subjects 
of the school curriculum,” and avoiding “ ties” as 
far as possible. They were also requested to indicate 
© апу particular circumstances which may have had an 
effect on the progress of any child, such as poverty or 
lack of'encouragement by the parents or lack of proper 
accommodation to do homework.” ‘The directions 
were thus’ of a general nature, and it was left to the 
head teachers to classify the children as best they could 
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in the light of the data available at each school. 
Reports from the head teachers show that the greatest 
care was taken in making the assessments in spite of the 
difficulty in comparing children who were in different 
classes or were taking different school subjects. It was 
of importance to ascertain the extent to which the 
assessment of a child after three years was influenced 
by that after two years, and we learnt that as far as 
possible the assessments were made from independent 
series of marks. 


Comments from the several head teachers are given 
below. 


School 2.— A full staff meeting was called. Every child 
was discussed in relation to general intelligence, term work, 
examination results, home conditions and health. The form 
teachers then compiled an order of merit based on the lists 
(of marks) and on the comments and infor 
at the staff meeting.” 

School 3-9 The order has been arrived at by taking the 
total of examination marks gained in each of the Autumn, 
Spring and Summer terms of the school year just closed and 
equating them as far as possible,” 

School 4.—" The order of merit has bee 
upon the term order obtained in school examinations, in 
Which all school subjects have counted equally for purposes 
of marks. . . . This method does not ‘really give any satis- 
factory comparison of boys in different forms who may even 
have been pursuing different subjects. I do not think that any 
valid comparison between such boys can in fact be obtained. 
Where boys were in different forms, regard was had to my 
own and my colleagues" knowledge of the boys concerned." 

School 5.—'* We had staff meetings. 
who їапрһї the children put them in an order of merit, the 
member's ranks were added up, an average was taken and 
the children were assessed in accordance with the result. 
The assessment after three years could not thus ‘possibly be 
affected by the assessment after two years. I have always 


mation supplied 


n based primarily 


- . . Every teacher 
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felt that there were too many factors to be taken into account 
for the questionnaire to have real scientific value.” (This 
method of assessment, in which the ranks in different subjects 
were averaged, is perhaps the best possible, since each subject 
is thereby given equal weight.) 

School 6.—* I have pointed out the wellnigh impossible task 
of making an order of merit on conditions which vary so con- 
siderably. I gave up the attempt of making a mere percentage 
of marks only, a basis of classification. My first raw list con- 
sists of all marks gained throughout the school irrespective of 
the number of the subjects, given as a percentage. This list 
presents innumerable anomalies in that the “ two-language ” 
people frequently lag behind the handicraft people. Marks for 
the handicraft people are generally higher than those for the 
two-language course. I therefore quite arbitrarily place the 
language people in a position which they ought in my opinion 
to occupy. In doubtful cases I consulted my colleagues.” 

School 9.—* The basis adopted was Form position decided 
by marks given for tests and examinations only. As the 
pupils were in different forms it was extremely difficult to 
allow for the difference in standard of the forms. I was not 
satisfied that the order of merit was sufficiently correct to be 
used in a scientific investigation. There is no possibility of 
the assessment after three years having been affected by the 
assessment after two years.” 

School 10.—* I have assessed the children according to the 
marks they gained in their annual examinations. Conse- 
quently the assessment for three years could not be affected 
in any way by the assessment for two years.” 


In general, assessments were made by summing 
marks in the different school subjects. It is unlikely 
that any adjustments were made to give equal weight 
to each subject, except in the case of School 5, where 
the excellent method of averaging the ranks in different 
subjects was adopted. Age allowances could not very 
well have been made, but in any case these would have 
no appreciable influence on the results of the inquiry. 
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Juniors and Seniors, i.e. the ro + and 11 + entries, 
were ranked separately, since they had taken different 
papers in English and Arithmetic in the admission 
examination. Н 

Correlation coefficients between the orders of merit 
after two years and after three years are given in Table 
3, page 18. The mean correlation coefficient of 0-755 
shows a fairly high consistency of performance from 
one year to the next, especially for such a highly 
selected group ; it also indicates that the forebodings 
of some of the head teachers as to.the scientific value 
of the assessments have not been realised, provided, 
of course, the two assessments were made on independ- 
ent data. We may estimate roughly the correlation 
that would have resulted had the same methods of 
assessment been applied to a representative sample of 
the population of children, by making the assumption 
that intelligence quotients alone were the basis of 
selection of those remaining at school after three 
years. Taking the standard deviation of І.О. as 
I5 for the population, the figure on which Могаў 
House norms are based, and applying the Otis-Kelley 
formula, we find the corrected correlation coefficient 
to be about огдо, a quite satisfactory figure. 

Valentine ! found a correlation of o:81 (s.e. = 0:026) 
between orders of merit for 169 pupils after two and 
three years in the secondary school. "The degree of 
selection of these pupils is, however, not available. 


6. Tuer INTERCORRELATIONS 


We have four variables, a criterion and the scores in 
the Intelligence, English and Arithmetic sections of the 
admission examination. The criterion is two-fold, 


1C. УУ. Valentine, The Reliability of Examinations, Univ. of London 
Press, 1932, p. 87. 
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an assessment by the head teachers after two years at 
school and after three years. We thus have for each 
school two sets of six correlation coefficients, one set 
for each criterion. "The intercorrelations of the three 
independent variables, Intelligence, English and Arith- 
metic, will be the same for each set. Product moment 
correlation coefficients were calculated by the method 
of “diagonal adding," scores being grouped with 
intervals of 5. Head teachers’ ranks were treated as) 
ordinary marks in reversed order; although. these: 
ranks are not in normal distribution, the effect of this 
approximation on the correlation coefficient was found 
to be negligible, as was to be expected. АЙ corre- 
lations were checked by finding the sums of squared 
deviations from two arbitrary zero points. Sheppard's 
correction for grouping was not applied, since its effect 
was found to be but small. As the correction always 
increases slightly the value of the correlation coeffici- 
ent, the degree of relationship between the several 
variables has been underestimated, an error on the safe 
side. Scores in the English and Arithmetic papers 
were taken for purposes of correlation without age 
allowances, since allowances had been awarded on the 
total score in the two papers and separate allowances 
for each paper were not available. The error thus 
introduced was small, for the correlation between age 
and score in a group of age-range of one year is at 
the most o:2 and a total correlation of 0:50 is only 
depressed to a partial correlation of 0-48 with age 
constant. The intelligence-test scores, however, 
made allowances for age in that they were expressed 
as intelligence quotients. ‘The head teachers’ orders 
of merit were probably drawn up irrespective of 
differences in age. 
The correlation coefficients are given in Table 4. 
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TABLE 4 


SuowiNG THE INTERCORRELATIONS OF THE SEVERAL VARIABLES 


PREDICTION OF SECONDARY-SCHOOL SUCCESS 


(1) S.R. is the School Rank, or Head Teacher's Order of Merit after two 
years or three years at school as stated. 


(2) Juniors are the ten-year-olds, and Seniors the eleven-year-olds. 


(3) The intercorrelations of Intelligence, English and Arithmetic are, of 
course, the same for the three-year group as for the two-year group. 


© IE CORRELATION COEFFICIENTS 
es | & 
Зе |е 
23 || Le|SR.|SR.| S.R. 19. | 1.0, | Eng. SE | SR. | SR: 
SA ан 2 уг. 2 yrs) 2 yrs. | | | 298 ` | 3 yrs. | 3 yrs. | 3 утэ. 
28 B and | and | and гана e d and |'and | and 
D 1.0. !Engl.Arith. TE | Аһ. Arith.| то. | Engl, | arith 
Entries, 1933, Juniors - 
2 [18105371 |:49 | :57 | +58 | 50 | +97 | +57 | -60 | :58 
3 125] 692] +332) «19 | “27 | -22 | 48 |-о7 | -44 | -о5 | "14 
4 136]|10:55| 558 | “об | -27 "32 E “22 53 36 44 
5 1331046035 | 34 | 537 | -43 | 63 | «sr | 557 | Зо | 49 
6 |36|roro| “36 | “го “23 “ЗІ "14 ‘or "45 *15 "23 
БЕЛА HEZ | з | 52 | -72 | -35 | 552 | 972 | 44 
to 138 /9851:38 | 50! -17°| 450 | -25 | з: І -36 | -48 |.-26 
Entries, 1933, Seniors 
GOA 50811068! | 55. IEE | бо | 550: | «74. | «59 13:52 
3 148| 9:97) 26 |-r4 | 47 | 53 | 46 | -2r *85! |25 10:59 
4 |44| 883| -29 | +16 | -23 29 | Зо | -28 | -22 34 Mo 
6 [48] 9°54] -38 | 47 | -то :34 *50 318 ма 122 "M 
9 |20| 9:18] 37.| 332 | 46 | 557 | -68 47 | 47 | +36 "57 
10 126 |12"25 32 | 48 | 432 42 +28 МІ 46 +36 "32 
Entries, 1934, Juniors 4 
3 |36|10:021:73 | 46 | 48 | -5о 1535 | -o7 :4371|2:35/ 417557 
4 1381.020 [чо | 0144 | 45 | чо | 52 | 8 | 38 
б. [53] 8:80 ат |-27 | 43 | -37 | -1q jea 23377433: |05 
10 137|:7:361554 1525 | -25 І зо | чи hen 43 І 27 | 20 
Entries, 1934, Seniors 
2 |28|9:48(:32*|:38 | -38 | *34 (аж | -o ч: | 27 5235; 
3 |34| 6:86| 46 1435 | -19 | зо | «18 к 43 та |227 
4 |32 [10:32] +38 |--06 | -20 46 +18 +08 42 оо 44 
6 [47] 784| 44 | -37 | -17 | -62 | -28 *37 *61 43 21 
10 |39| 9:03| :52 | 17 | ча 55 221 “20. 64 27 13 
22 
groups |765| 9167] -442| -323| -304 | -437 | -357 1194 | “454 | -335 | '330 
No. of z values 
exceeding {һе 
mean by more 
than 26. Шан І о о 1 1 о І о 
No. of z values $ 
less than the : 
теап by more 
..thanaG . ‚| о I o o o 3 о o 1 
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The averaged coefficients at the bottom of the table 
were obtained by Fisher's z technique.* 


'The correlations between each pair of variables are scat- 
tered over a fairly wide range. This might have been ex- 


pected, for the entries into different schools in a given year are “ 


not truly random samples of those receiving scholarship 
awards, Some successful children were refused secondary- 
school education by their parents (about 6 per cent. of the 
total awards), the distribution of ability in different towns and 
villages of the West Riding will certainly not be uniform, and 
the level of ability of those leaving the secondary schools 
before their second or third year had been completed was not 


likely to have been the same for each school. It is, however, | 


a matter of interest to see how closely these correlations 


comply with the assumption that they are derived from | 


random samples of the total secondary-school population. 
For this purpose the extreme values in each group have been 
tested for significant divergence from the mean of the group. 
The method, that of Fisher, is illustrated by the following 
‚ example from the first column of correlation coefficients. 
The highest coefficient in this column is 0:73, the significance 
of whose difference from the mean of 0:442 we desire to test. 


N Lost ДЕЛЕ “Мз erc 
| 
| | | 
36. ATA 70225285 зЗ lr 
765 | “442 | -475 699 "00143 
| Diffce. | Sum 
|= 454 | berra 


The ‘z values corresponding to the 7s are obtained 
from Fisher’s г table. The figure of 699 for the value of 

1р. A. Fisher, Statistical Methods for Research Workers, 7th edition, 
1938, par. 35, p. 209. The numbering of the pages differs according 
to the edition, but the paragraph numbering has been preserved. 
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(N — 3) for the mean is the sum of the values of (У — 3) 
for the individual observations, that is 765 — 66, since there 
are 22 observations of r. The variance of the values of z is 


N І 3 and the sum of the two variances, -03173, is the variance 
of the difference of the two z's, 454. The square root of 
:03173 or “1781 is the standard error of this difference. The 
difference expressed in standard units, or the significance 
ratio, is -454/-1781 or 2:55. 

In this way we have found the differences expressed in 
standard units between the outliers of the 198 correlations of 
the table and the means of their respective groups. The 
distribution of these differences is shown below : 


Limits of difference | Differences ex- | Differences less 

in standard units | ceeding the mean | than the mean 
310-319 I o 
2:70-2:79 I I 
2:50-2:59 2 о 
2:40-2:49 о I 
2:30-2:39 о І 
2:10-2:19 I I 
2'00-2:09 о I 
: Total 5 5 


, The incidence of these differences in respect of each pair of 
| variables is shown in the last two rows of Table 4. Strangely 

enough, of the 22 correlations between English and Arithmetic 

four show deviations (expressed in terms of 2) from the mean 
| of more than 26, whereas only one out of 22 should exceed 
| 20 if the samples were truly random. Although the averaging 
| of significantly different data may not be statistically respect- 
| able, the circumstances of the experiment seem to preclude 
| any other course, while the omission of the aberrants would 

present an incomplete picture of the situation. 
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7. Recression COEFFICIENTS AND THE PREDICTION 
OF THE CRITERION 
The averaged correlations give us two matrices from 
which regression coefficients and multiple and partial 
correlation coefficients can be calculated : 


The following notation has been adopted : 


x, = Rank in secondary school according to head 
teacher’s assessment. 
` X, = Intelligence quotient] Data from the 
хз = English score Г admission 
X, — Arithmetic score | examination. 


The correlation matrices are as follows : 


TABLE 5 
Snowinc AVERAGED CORRELATION COEFFICIENTS 
Assessment after 2 years Assessment after 3 years 
W = 765) W = 765) 
81234 Xg “а Хі Wg Яз. “а 
ж, | — сщз “аз Зо] аа] — Е 1335 зо | 
Xy [да — 37 7387 | за] E 7357 
& еда, SER а 02291: EO 2335 GER = а 
Жа! ЗО 7357; OKA E а ER а 


The reciprocal of the submatrix for variables xs, Хз 
and x,, with unities as diagonal elements (it is the same 
for each of the two matrices) was then found, and 
regression coefficients and their standard errors were 


calculated by the method given in Appendix І. 


The results follow in Table 6. 
"The foregoing regression coefficients are the weights 
by which the standardised scores in the three variables 
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TABLE 6 
SHOWING REGRESSION COEFFICIENTS AND THEIR SrANDARD ERRORS 


(1) The significance ratio is the ratio of the statistic in question to its 
standard error. 


(2) P represents the probability that the statistic observed in the sample 
of 765 cases could have arisen by chance alone on the assumption that it was 


secondary-school population after three years' schooling. For example, the 


— бу) for the two-year assessment could have 
arisen by chance alone is only -0063, or 6:3 chances in 1000. We may conclude, 
therefore that b, is significantly greater than. bis. 


Assessment after 2 years Assessment after 3 years 


Stan- |Signifi- 
Regression| dard | сапсе 
Coefficient | Error | Ratio 


] Stan- |Signifi- 
P |Regression| dard | cance | P 
Coefficient | Error | Ratio 
pm 13177 |:0379| 8:59 |-оооо] :3178 | -0365| 8:71 | ооо0 
13424 “1530 52] 4:35 |"0000] -1602 *0347| 4:62 | -0000, 
1423 "1609 70339| 4:75 |:0000| -1854 70334| 5:55 | "0000 
i2 — ба] “1645 70604 | 2:73 |-0063| -1576 *0596| 2:64 |:0083 
бз — bia| -1568 | 19573] 2774 [-ообі] -1324 :0566| 2:34 |'0192 
barba -0079 | -0499| 0-16 :873 | “о252  |-0493| о-ы: 154610 
Multiple Correlation Multiple Correlation 
Tura = 7489 Gu = 7509 


must be multiplied in order to 


of secondary-school Success ; they may therefore be 
regarded as measures of the relative values of the three 
variables in predicting success in the sample of children 
Írom which the present statistics have been derived. 
It is important to note that regression coefficients for 
raw scores are not to be taken for this purpose, for they 
are arbitrary quantities which can be changed accord- 
ing to caprice by changing the unit in which the vari- 
able is scored.! ` Scores must therefore be standardised 
in order to put each variable on the same footing, 
before any just Comparison can be made. It may 

ЗА recent valuable inquiry into the Prediction of success in School 
Certificate subjects by means of an examination at 11 + has unfor- 
tunately used regression coefficients for Taw scores to assuss the merits 


of the predicting variables, (See T. E. Stubbins, Briz. Journ. Educ. 
Psy ch., 1940, 10, 16.) 


give the best prediction 


E 
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appear at first sight that when scores have been stand- 
ardised the efficiency of a test, which discriminates 
better than another similar test, and has a higher 
standard deviation of raw scores, is not reflected in its 
regression coefficient. Such a test, however, will have 
a higher reliability coefficient and in consequence a 
higher correlation with the criterion. Although its 
correlation with the independent variables will also be 
raised, the net effect of its increase in reliability may be 
shown to be a higher regression coefficient, positive 
or negative as the case may be. 


Regression coefficients for standard scores in one sample 
of the population may be readily converted into thóse for 
another sample in which the standard deviations of the vari- 
ables differ, by making use of the fact that regression coeffici- 
ents for raw scores are independent of the distribution of the 


independent variables in the population.* 
Тб Хээ Ха)» + - - ае тауу Scores measured from the mean, 


and wis 03. • • • regression coefficients for raw scores, we 
have 

^ 

Xy = Wia + wis К.с. 


Standardising the scores 
^ 


23 GORO GORO 
GEEAE 201323 SOEK 
Oy 031/92 1/93 

А. X; Ea 
-Writing z; for = and by for (гна), 

Gi с. 
^ i 

24 = betek н Т... 


б. с, 

23 bg = 103, etc. 

бі бү j 
Similarly for another sample with standard deviations 

215513 7914, СГС, the regression coefficients are given by 


or руз = 2012 


3 

B 2 -2 B 5 tc. 
“12 3 213 135? 

12 01 x xy 


ІВ. А. Fisher, Statistical Methods for Research Workers, 7th edn., { 


1938, раг. 25, p. 135- 
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сі У 
egi Bab 

ба Dy / 


The regression equation for the second sample in terms of 
standardised scores Z; thus becomes : 


сі 5, Я 
13 зе, 
сз 2 


Hence By, = 5, 


dee a 


a бі X, c; Ў 
=}. °7„-! 1 
21 12 1 27 1305 X 


1 
Go d 
8. THE [NFLUENCE OF SELECTION 
Up to the present our statistics have concerned a 
sample of secondary-school children of an entirely 
artificial composition. The sample is the end result 
of a selection by many diverse influences from the 
population of elementary-school children of examina- 


tion age. The first selection from this population was. 


that of candidates for the admission examination by 
means of a test in English and Arithmetic given in the 
elementary schools. From these candidates the en- 
trants to the secondary schools were selected mainly 
on the results of the English and Arithmetic papers of 
the admission examination, for the border-line candi- 
dates also by performance in the intelligence test. 
Another class of entrants was the fee-payers; about 15 
рег cent. of the total, admitted in spite of a poor 
examination performance. Some successful children 
will have been refused Secondary education by their 
parents, while others will have been excluded by 


accidents of circumstance such as ill health. Further 


selection will have taken place by the departure ofa 
number of children, 


e mostly the duller, before the end 
of their third school year. The situation is thus one 
of extreme complexity. If, however, those influences 
other than examination scores which have determined 
selection are of a random nature and are uncorrelated 
with the criterion, they will have no Ьеагїп оп the 
statistics of the inquiry. ' We shall necessarily have to 


de 
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ignore the unknown elements in the situation, making 
the only practicable assumption that these are random, 
and that selection has occurred solely through the 
scores of the three parts of the admission examination. 

'The effect of these last three processes of selection 
is to reduce the standard deviations of the several 
variables апа their intercorrelations below the values 
' for the unselected population. "The standard devia- 
tions will not all be reduced to the same relative extent, 
however; for since English and Arithmetic were the 
dominating grounds of selection, the fall in standard 
deviation of the intelligence test will be mostly 
determined indirectly through its correlation with the 
two other variables and thus will be proportionately 
less. As a result the correlation of the intelligence 
test with the criterion will not suffer so great a reduc- 
tion as that of English and Arithmetic, and therefore 
the regression coefficients calculated for the sample will 
unduly favour the intelligence test. To make a fair 
comparison, we must calculate а whole new set of 
statistics which relate to the complete population of 
children about to leave the elementary school. "This 
is a standard population likely to show but little 
difference from one educational area to another, so that 
its statistics will have general application ; it is also 
that population from which the admission examination 
has to select those suited to secondary education, and 
its statistics will therefore give the truest interpretation 
of the results from the admission examination. 

We first require to know the standard deviations and 
intercorrelations of the three sections of the examina- 
tion in the unselected population. Fortunately we 
have in our records at Moray House the scores in a 
imilar examination of over 1,100 children of age 19 
19-11 from West Riding schools, chosen to be as 
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nearly representative of the district as possible.! ‘The 
papers were set by the same examiners as those in the 
present inquiry, and the contents of the two groups 
of papers were closely parallel. 

We have to find next what the standard deviation of 
the head teachers’ assessments would have been, if they 
had been made on the whole population. This is done 
by the use of Aitken's matrix formulation of Karl 
Péarson's selection equations,? applied to the case 
where one variable, the criterion or x, is influenced by 
induced selection through three other variables, xg, 2 
and ха. We thus arrive at the statistics given in Table 
7, obtaining the correlation coefficients with the 


TABLE 7 


Snowing STANDARD Deviations AND INTERCORRELATIONS 
FOR THE SECONDARY-SCHOOL SAMPLE AND FOR THE Un- 
SELECTED POPULATION or SCHOOL CHILDREN 


Standard Deviations 


Population 


Sample Assessment Assessment 


after 2 years | after 3 years 


Seno! Rank віз 11-233) B= 1465 | Se 1497 


d базе 9:67 У, = 15:00 У = 15:00 
English А Og = 12:77 Ls = 23:44 Ze = 23°44 
Arithmetic Sr 16-01 | Х,= 25-89 2, 25:89 


Notes —(1) The value of с; was found by averaging the 
variances of the ranks in each school, allowing for the loss of 


1The data were acquired in the course of an investigation by the 
West Yorkshire National Union of Teachers, published by the Uni- 
versity of London Press. Е 
"ЗА. С. Aitken, Proc. Edinburgh Math. Soc., 1934, 4, 106. An 
illustrative computation is given in Appendix 2. 
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one degree of freedom in making the estimate for each school ; 
it is thus an artefact depending on the number of children in 
the school. It is, of course, the same for both  assess- 
ments. Similarly the derived values of У; are of ап 
artificial nature, but they may be legitimately used for 
estimating the regression coefficients and correlations in the 
population. 

(г) Ж» is the s.d. of І.О. in the population, and is taken as 
15:00 since Moray House tests are standardised to this scale. 


Correlations 


The correlations for the selected sample are given in 
Table 5. 


The correlations for the population are as follows : 


Assessment after 2 years Assessment after 3 years 

Or ae DES CS хі. Kat Ха: «22A 

хі] — "719 -683 -671 хр | —  :736 ,702 694 

хә | rra — "833 -809 ха | +736 — 833 -809 

Ха | -683 :833 — 0760 Хз | +702 -833 — -769 

ха | -671 “8оў +769 — Ха | “бод. :809 +769 — 

Multiple Correlation Multiple Correlation 1 
Ry.934 = 7743 - Ri.o34 = 7764. 


Note.—The standard errors of the correlations with the 
criterion, ху, can only be roughly estimated ; they are in the 
neighbourhood of o-o19. The correlations between x, x4 and 
x, have standard errors of about 0:012. 


criterion in the population as a by-product. Small 
letters denote statistics for the selected sample, and 
large letters for the whole population. All the data 
are based on observed values, except Я; and correlations 
with the criterion in the population, which are 
calculated from the others. : 

"The correlation coefficients relating to the assessment 
after two years show but little difference from those 


. 
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after three years. Contrary to expectation each 
variable predicts slightly more accurately after the 
passage of another year; this difference, however, is 
not significant. It, could have arisen from random 
influences alone, while a more accurate grading of the 
children at the second assessment as a result of experi- 
ence may also have had its effect. ` 
Regression coefficients for standard scores in the 
population may now be found either from the correla- 
tion matrices in Table 7, or more readily from the 
regression coefficients in the sample by making use of 
the fact that regression coefficients for raw scores are 
independent of selective influences (see page 29). 
Taking for illustration the regression of assessment 
after two years on intelligence quotient, we have from 
Table б, b,» (for standard scores in the selected sample) 
—'3177. The regression coefficient for raw scores, 


2013, 18 bjs X a, and that for standard scores in the 
2 

га У 11:2 15:00 

opulat bj, X Ax 22 ua WEEE) ea кә 

рор 10N 15 015 97, a, 3177 Х 967 = 14:65 

GERO 


Table 8 gives these regression coefficients. 

From the regression coefficients for the population 
the multiple correlations of "Table 7 are found. It 
Will be noted from the columns giving the percentage 
weights of each variable for best prediction that but 
little difference is shown between the respective weights 
for the sample and for the population. What differ- 
ences exist are almost certainly not significant. 

We may note that had the degree of selection, as 


G; 5 + 
measured by ур been the same in each independent 


variable, the relative values of the regression coefficients 
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TABLE 8 


Snowinc REGRESSION CoEFFICIENTS FOR THE SECONDARY- 
SCHOOL SAMPLE AND FOR THE UNSELECTED POPULATION OF 
SCHOOL CHILDREN 


Assessment Assessment 
after 2 years after 3 years 
Sample Population | Sample | Population 
Prose 3177 “3779 3178 “3699 
13:24 +1530 +2152 +1602 +2205 
Бэз “1бод 1995 1854 +2250 
Percentage | 

weights 95 pA 2 2 
за (TQ) 503 477 479 453 
ха (English) | 242 271 24:2 27-1 
x4 (Arith.) 25:5 25:2 27:9 276 


for standard scores would have been the same in both 
sample and population; for the regression coefficient 
for raw scores, т say, is the same in both cases. ‘Thus 
balba (for the sample) = wiels X 9318) апа Bis[Bss 
(for the population) — 2032] 913 X Zale denoting re- 
gression coefficients for the population by Вы. These 
expressions are obviously equal when gele = вз/ з. 

Since in most inquiries similar to the present the 
degree of selection in each predicting variable will be 
roughly the same, regression coefficients based on the 
highly selected sample remaining in the secondary 
School will give a fairly accurate measure of the 
relative prognostic values of the variables, and if this 


information suffices the somewhat labotious corrections 
In the present case we' 


for selection may be omitted. 
have в,/5, = 645; 9/2: = -545 and. а/а = 618, 
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and we have seen that even with these differing degrees 
of selection the relative weights of each variable are 
not greatly changed. If, however, a measure of the 
predictive value of the whole examination in the 
population is required, we must first know the standard 
deviations and intercorrelations of the independent 
variables in the population, and then must apply 
the correction for selection before the desired correla- 
tions with the criterion in the population can be 
found. 

The standard errors of the regression coefficients for 
the population bear a simple relation to those for the 
sample (see Appendix 1). They are given іп Table 9, 
which may be compared with similar data for the 
sample given in Table 6, page 28. i 


TABLE 9 


SHOWING STANDARD Errors OF REGRESSION COEFFICIENTS FOR STANDARD 
Scores IN THE POPULATION 


%ı = School Rank; x, = LQ.; x, = English; x, — Arithmetic. 


Assessment after 2 years Assessment after 3 years 


3 Stan- |Signifi- 5 Stan- |Signifi- 
Regression| dard | cance | p | Regression dard H 


З сапсе | Р 
Coefficient | Егтог | Ratio Coefficient | Error | Ratio 
Bia, :3779 :0440| 8:59. |-оооо -3699 0425) 871 |0000 
Bisse 11152. |:0495| 4:35 |:0000] -2205 | -0477| 4:62 |-оооо 
14:23 *1995 70420| 4°75 |-0000] -2250 *040; `55 |20000 
By, — Gua 1627 10783 | 2-08 |-0376| аа 


+1494 :0756| 1-98 [0478 
"1449 0672 | 2:16 |-0308 


By —By| 1784 *0696| 2:56 |-oros| 
| төө “0641| 0:07 |:944 


Bis — By *0I57 *0664| 0-24 |-810 


See Table 6, page 28, for an interpretation of the values of P, 


9. Tue Retative Prepicrive VALUES or THe THREE 
Examination VARIABLES 

In estimating the merits of the Intelligence (хь), 

English (ха) and Arithmetic (хц) papers in their power 

to predict later performance (х), we must distinguish 
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between the merit of each paper (а) when considered 
independently of the other two, and (b) when forming 
part of a team with theother two. In the former case 
the square of the correlation with the criterion is a 
suitable figure of merit, since it is the proportion of the 
variance of the criterion measured by the test. In the 
latter case we must take into account the correlations 
of the predicting variables amongst themselves, for if 
two of the variables are very highly correlated they mea- 
sure almost the same aspect of the criterion ; the result 
is that if one variable predicts the criterion slightly 
better than the other, it will have a much larger 
regression coefficient, since its mate has but little left 
to do. The relative merits of the variables in a team 
must therefore be judged by their regression С0- 
efficients. 

We will consider each case separately and confine 
ourselves to the statistics as estimated for the popula- 
tion. 

(а) The squared correlations with the criterion are : 


Assessment Assessment 
after 2 years | after 3 years 


EGOTZI 517 1542 
HEIC б We -466 :493 
Сүү 0 3 +450 -482 


The intelligence test shows itself superior to the 
other two, and this superiority is almost significant 
at the 5 per cent. point as judged from the standard 
errors of the correlations in Table 7. 

Tt is of interest to compare the correlation between 


intelligence test and criterion with that of the best 
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weighted combination of English and Arithmetic with 
the criterion. "Thus: 


Assessment 
after 3 years 


| Assessment 


| after 2 years 
1 


Riz 


1°34 


719 | :736 
'720 742 


"These correlations are, of course, estimates, subject 
to a standard error in the neighbourhood of ge, and 
the very close agreement between be and Ry:3, might 
be disturbed in one direction or the other by another 
investigation in which larger numbers of children were 
taken. We may, however, зау that on the evidence 
available the substitution of papers in English and 
Arithmetic by one intelligence test would be justified 
in an admission examination in which one or other 
alternative had to be employed. 

(4) Turning now to the relative merits of the three 
tests when employed as a battery, the regression co- 
efficients of Table 9 taken along with their Р values 
show that the intelligence test is significantly superior 
to the two attainment tests for predicting performance 
both after two years and after three years in the 
Secondary school. Its effectiveness is nearly equal 
to that of the other two taken together. ‘The English 
and Arithmetic papers have about equal prognostic 
value in the team, and their regression coefficients are 
not significantly different. 

€ proportion of the variance of the criterion 
measured by the team is given by the square of the 
multiple correlation coefficient, that is *552 for the 


assessment after two years, and :584 for the assessment 
after three years. : 
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IO. PARTIAL CORRELATION COEFFICIENTS 

The partial correlations for the population derived 
from the estimated total correlation coefficients of 
Table 7 are given in Table то; the total correlations 
are also given for sake of comparison. 


TABLE то 
Suowixc THE PARTIAL CORRELATIONS BETWEEN THE 
VARIABLES, As ESTIMATED FOR THE POPULATION 


Assessment after 2 years 


Ry =°719 Rau = "683 Кі =-6ўї Raya "561 
Riss = 371 Rise = 1219 Riyo ='219 Har 7476 
Riga = 7404 Risa = "352 Күз = "312 Када 7292 
Кузза = 267 Riga. 166 Rigg = “166 


Assessment after 5 years 
Куз =:736 К, 27925 “бод Rosa = "561 
Rizs =:384 Rise = 7237 248 Каз = 76 
Riza =°413 Куза == "366 Күз — "339 Кзаз = 7292 


Riesa = 269 Pagar "178 buen = “192 


111 


'There із but little difference between the corre- 
sponding partial correlations for the assessments after 
two and three years. ‘The progressive fall in correla- 
tion with the criterion (хі) as first one and then two 
variables are eliminated indicates that each of the 
three sections of the entrance examination measures in 
‘the criterion in large part what the other two measure. 
The fall is much the greatest when the first variable is 
eliminated ; this is a consequence of the high correla- 
tion between the removed variable and the criterion. 
The removal of а second variable causes a relatively 
small fall, since this variable correlates highly with that 
first removed. ` 

That portion of the criterion measured by one 
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variable and not by the other two is revealed by the 
partial correlations in the last row of the two tabula- 
tions. The intelligence test obviously stands up best 
to the successive refining processes ; it also has more in 
common with the English and Arithmetic papers 
taken separately, than have the latter with each other 
after eliminating their connection through intelligence, 
as is shown by the last column of the table. 

The standard errors of these partial correlations can 
only be roughly gauged, since the total correlations 
themselves were estimated by the selection formula, 
and their own standard errors are not accurately known. 
However, the partial correlations are not likely to have 
a standard error exceeding 0:03. 


II. Discussion or RzrsuLTS 


The multiple correlation, -764, representing the 
degree of concordance between entrance-examination 
results and performance in secondary school after three 
years, though as high as might be expected, shows con- 
siderable departure from perfection of prediction ; 
it is therefore of interest to inquire how far prediction 
might be improved. In the first place we must recog- 
nise that there is no consensus about the meaning of 
Success in secondary-school life. Do we mean satis- 
factory academic attainments, and if so, are we to count 
as successful a boy who is brilliant in one subject, say 
Mathematics, and a dullard in most others? Do we 
mean qualities of character, which are developed by 
the social contacts in a secondary school, and if so, 1s 
the boy successful who is adventurous, ambitious, a 
leader amongst his fellows, and yet has only mediocre 
scholastic success ? Even if agreement were reached 
as to the nature of the criterion there would still be 
doubt as to the accuracy of measurement of its various 
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components, and still greater doubt as to the extent to 
which each component should be weighted. 

In the present inquiry it appears that the head 
teachers assessed the pupils mainly on the marks 
obtained in all subjects of the school curriculum. The 
correlation between the assessments after two and 
three years, viz. about 0-90 (see p. 22), shows that the 
basis of assessment within one school was much the same 
at the two times. But it does not follow that all 
schools adopted the same basis, and in all probability. 
a considerably lower correlation would have resulted 
if it had been possible for the second assessment to 
have been made by a head teacher from a different 
school ; one might even doubt whether a correlation 
of ogo would be obtained between assessments of 
children in one school made at the same time by 
different teachers. 'ТЫз lack of definition of the 
criterion places an upper limit to the prognostic value 
of any admission examination, for the correlation of an 
examination with future performance can never exceed 
the square root of the reliability coefficient of the 
criterion. Professor C. Spearman! has stated that 
correlations between present and future performances 
up to 0:99 may be expected; this estimate on the 
above grounds alone appears to be most highly improb- 
able, not to say impossible. 

Even if the criterion could be rigorously defined 
and measured, there are many influences which mili- 
tate against the successful prediction of children’s 
performance some years later. After children leave 
the primary schools new interests and abilities develop, 
temperamental qualities change, and in the different 


1Report on “ Conference on Examinations,” III, held at Dinard, 
France. Bureau of Publications, Teachers’ College, Columbia 
University, New York, 1939. Pages 160 and 185. 
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educational and social environment of the secondary 
school an entirely new attitude towards school work 
may show itself. There are also vagaries inherent in 
the admission examination itself ; a child’s form on the 
day, special coaching, facilities for home work and 
encouragement from parents, are but a few of the 
uncontrollable factors which cause erratic results and 
reduce accuracy of prediction. It is thus perhaps a 
matter for wonderment that an examination occupying 
less than three hours should predict as successfully as it 
does. 

Evidence is accumulating that an assessment by 
teachers in the primary schools gives at least as good a 
prediction as any of the papers іп an admission exam- 
ination ; and it is to be hoped that such assessments 
will be given more and more consideration in the near 
future, once it has been found possible to co-ordinate 
the assessments from different schools. A knowledge 
of a child’s work and abilities extending over several 
years must necessarily have a large measure of prog- 
nostic value, and this valuable source of information 
should not be neglected. 

Turning now to the examination which has been our 
special study, we have seen that the intelligence test 
has shown itself significantly superior to the English 
or Arithmetic papers. ‘This result was achieved in 
Spite of the fact that the two intelligence tests in 
question performed their function only passably well. 
The discriminatory efficiency of the tests was low, as 
evidenced by the standard deviations of the raw scores 
of the candidates, 11:58 and 13:54 respectively. At 
the present time tests could readily be constructed to 
give standard deviations of from 20 to 22. Such 
increased discrimination would be reflected in higher 
reliability coefficients, proportionately higher corre- 


<r 
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lations with all other variables, and higher regression 
coefficients. 

With an improved intelligence test the multiple 
correlation of the three variables with the criterion 
would be appreciably higher than that now found, 
viz. 0-764. The present multiple correlation 15, 
however, no mean achievement, for it is an under- 
estimate of the true correlation, since the criterion is 
but loosely defined and inaccurately measured. Pro- 
fessor Thorndike at the International Conference on 
Examinations? held at Dinard in 1938 remarked in 
relation to another examination: ‘I am convinced 
that no practical wisdom of any teacher would ever 
give you a prophecy; that is as good as this -80 that you 
have already. . . . І very much doubt whether at the 
present time a year under observation in an orientation 
school will give you a correlation for the future of much 
better than 0-80.” 


12. SUMMARY 
1. The head teachers’ assessments of 765 children 
at the end of their second and third year in secondary 
schools have been compared with their scores in an 
admission examination comprising a group verbal 
intelligence test, an English paper and an Arithmetic 
paper. | 
2. The statistics relating to this selected sample of 
secondary-school children were converted into esti- 
mates for the complete unselected group of examina- 
tion age, and from these data comparative measures of 
the effectiveness of the three parts of the examination 
were obtained. 
3. The multiple correlation of Intelligence, English 
. and Arithmetic, with the assessment after two years at 
1] c. cit., page 185. 


44 PREDICTION OF SECONDARY-SCHOOL SUCCESS 


secondary school was 0-743; with assessment after 
three years it was 0-764. These correlations are 
depressed below their true values because the criterion 
could not be exactly defined nor accurately measured. 

4. The best single measure of later performance is 
given by the intelligence test ; its superiority to the 
English and Arithmetic papers is almost significant at 
the 5 per cent. point. 

5. When the three variables are considered as a team, 
the intelligence test is significantly superior in prog- 
nostic value to the English or Arithmetic papers: it 
is, in fact, almost equal to the English and Arithmetic 
papers taken together in their best weighted com- 
bination. 

6. A still greater predictive value of the intelligence 
test could be expected with a test specially designed 
for the age and ability of the candidates for admission 
to secondary schools ; a corresponding increase in the 
multiple correlation of the team of tests with the 
criterion would follow. 

7. The prediction of assessments made in ‘the 
secondary school after three years was slightly better 
than that of assessments after two years. The 
difference, however, was far from significant. 

8. Some comments on statistical methods have been 
made. It is pointed out that regression coefficients 
must be related to standard scores before they become 
measures of the relative merits of the predicting vari- 
ables. Further, if in the sample of children the degree 
of selection is not the same for each independent vari- 
able, the regression coefficients must be corrected for 
the influence of selection. In practice it appears that 
moderate differences in the degree of selection in the 
several independent variables do not affect seriously 
the relative values of the regression coefficients. 


PREDICTION OF SECONDARY-SCHOOL SUCCESS 45 


9. The size of the regression coefficients and correla- 
tion coefficients is adventitiously determined by the 
rigour of selection of the secondary-school sample. 
It is therefore necessary to relate all such statistics to 
the complete population of children about to leave the 
elementary schools. In order to do so the standard 
deviations and the intercorrelations of the predicting 
variables in the population must be known, апа thus 
the multiple correlation in the population may be 
found. 


APPENDIX I 


Tue CALCULATION or REGRESSION COEFFICIENTS AND THEIR 
STANDARD ERRORS 


Regression Coefficients, Буззд etc. (for standard scores), 
of a criterion, хі, on several experimentally independent 
асаре Gr x Gry oe аге given Бу the following 
equations : 
Бэла... = pik 71578 + 25542060 
Бала... 718723 d pei рта .... etc., 


where 79 is an element of the reciprocal matrix of the correla- 
tions of the independent variables. 


The Multiple Correlation rg, . . . , is given by 
Piesa.. = bissa.. Tiat bas, park bisos.. Tut es 


The Standard Errors of the Regression Coefficients are given by 
P21 — Tioga 


2 

с? = nd 

2o Un... WEST 

where p is the number of independent variables, and A the 

ED of cases on which the correlation coefficients аге 
ased. 


The Standard Error of the Difference between Two Regression 
Coefficients is given by 


c? (з Spt 1212) (т сы берту, 2 
Her bal N—p—1 


etos 


, It is well to remark that 7% is itself usually negative in 
sign, so that the term (— 2793) then becomes positive. 


In the course of our inquiry we found two sets of regression 
coefficients, one set (04) for a selected sample of children and 


46 
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the other (Ву) an estimated set for the unselected population. 
The standard errors of the second set are readily found from 
those of the first set as follows : 

Putting B,,/b,; = be then св; = bu thus, EE 
DM = By 265, dha Also 
2 72L k 
c? (RP yor? + Hiz 2019613725) Zuga, du 
B —B з) A я Зу NAI 
12187 5 гата 


te б” 
similarly for ` (815 544), etc. 


The only arithmetical process that requires explanation is 
the calculation of the reciprocal of the matrix of the correla- 
tions of the independent variables with unities as diagonal 
elements. When there are only three independent variables, 
the reciprocal matrix is : 


G — ZA xar rei (res ga — 724] A 
(Teatsa — 723)/ A (1 — ®.)/А Hatza — T34)/ A 
Og = raj] ^ (Tas sa — T34)/ A (1 — 7°95)/A 


2 
where А = 1 — 7°95 — 1794 — 1734 + 2793724731: 


For example (1— 755)/A is the element 72, and 
Herta — 7з)] А is the element 734. 


When there are more than three independent variables 
Aitken's method of pivotal condensation should be used to 
evaluate the reciprocal matrix. This is fully described by 
Professor Godfrey H. Thomson in the Journal of Educational 
Psychology (1936, 27, 44) and an illustrative computation is 
given in Appendix 3 of this article. 

It is scarcely possible to go wrong in the arithmetical work 
as checks are available at every stage. The following checks 


are important : 


(1) On the reciprocal matrix 
TÉ pray pr Rs 

Tost ek fae sies 

a Verte ats rai dr Б... 
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In words, the inner product of a row of the original matrix 
with the corresponding column of its reciprocal is unity, and 
the inner product of a row with a non-corresponding column 
is zero. 

(2) On the regression coefficients 

bis бзэ + Рага Т... — Га 
Базы + bisat - - -= Ta 
bark за Ба Т... 714 


И! 


APPENDIX II 


Tur [INFLUENCE OF SELECTION ON THE VARIANCE AND 
COVARIANCES OF THE CRITERION 


In our particular problem we know the variances (б?) and 
covariances (с;0;7;) of the three independent variables in both 
the secondary-school sample and in the population; we also 
know the variance and covariances of the criterion in the 
sample. We require to find the variance and covariances of 
the criterion in the population, and hence the correlation 
coefficients between criterion and independent variables in the 


population. 
We use the same notation as previously : 


ху, the criterion or assessment in secondary school ; 

EP ORS 

ха, English score ; 

x4, Arithmetic score. 
c and X are standard deviations in sample and population 
respectively, r and R correlation coefficients in sample and 
population. 

Our observed data are as follows. First the matrix of 
variances and covariances in the sample. 

с | 6162712 9103718 0194714 


Jo асанна Sa 


i 
1 
| ' 
i 
1 2 
Gre бг Garaia 0254724 Ug | Uap 
= ! 2 = [сс ZENO 
2 i 
0103713) бэбз'гз E ©3047з4 Up, ! Upp 
! 1 
; т. Og | 
бүбү! С264724 0304734 а ! 


‘Also the variances and covariances, in the population, of the 
three variables Ху х; and x4 through which selection has 
occurred. These are given in the bottom right-hand quadrant 
of the partitioned matrix V below. 

у 49 
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x; |212.» EQEQR, 5,5,8, 

Zua) Ж? 5,548, У,3,8, [4 
үе 


| =: 
жө уо, Забава Dy EAEN [Ўы 
] 


1 
EQEXQRQQEQEQRa, Уз, x; 


It is required to find the values of the elements in the first 
row or column of 7. Partitioning the matrix as shown, we 
have to find the values of the elements in submatrices He OF 
Hegia 


Aitken's formula gives Й = 7,0 ! 
and 7, = D+ C'V,,C, 
where C = Upy ! Ung 

and D= U,, —U,,C, C' being the transpose of C. 

It may be noted that the elements of matrix C are the 
regression coefficients for raw scores. 

Although these'formule may seem forbidding, the computa- 
tions are within the scope of anyone who can do simple 
arithmetic accurately. We illustrate from the data for assess- 
ments after three years at the secondary school. 


For the sample we have бү = 11:233. 745 = 4454 Tag = 7437 
Gar 9:67 Dar "335 T24 = "357 
O03 = 1277 744 — “330 T34 = “194 
And for the population, 
Zar 15:00 К, = +833 
Уз = 2344 ` Ёз, = :809 
Gar 2589 Кз, = 769 
Substituting in the submatrices of U. К 


Оа = [126180] Up= [49315 48054 59:347] 


49:315 | . 95509 53963 55270 
Har | 48054 | Up= | 53963 163073 39:663 
59347 55'270 39:663 256-320 


E 
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We now have to find б. We shall denote the elements, 
in Upp by “дэ tog, Uog etc. ; thus Kas = 93:509, иза = 39:663 5 
and.the corresponding elements in the reciprocal matrix by 
u?2, 423, 424 еіс. 

If there are more than three independent variables the 
reciprocal of U,, is best found by Aitken's method of pivotal 
condensation given in Appendix 3. In the present instance 
we may proceed by a shorter method. Since in Upp the 
diagonal elements are not unity, the short method for three 
variables given in Appendix 1 is not applicable here, but 
the principle involved is the same. We find first the deter- 
minant A of the matrix Upp. This is given by 


A—ttss(tgstt ag — tga?) ratuz + наба — 
14153) = 25753,503:106 


Then ULM 
Datuen Pe (излиза reala REO 
=| (Weattgg—Uogtaa)/A Gesta чад) А Darren tesisa 
| (бәзиза— 24153) А (изаизз— иззиз)[А (иззизз— наз [А 
146:089 — 42:272 — 24:960 the factor 1073 being 
—42:272 — 75:952 2:638 | x 1074, applied to each ele- 
—24:960 — 2:638 — 44:804 ment in the matrix. 


We may check this result by noting whether the inner pro- 
duct of each row of U,, with the corresponding column (or 
row since the matrix is symmetrical) of 07,518 unity ; also- 
whether the inner product of each row of U,, with a non- 
corresponding column (or row) of Ul is zero (see Appendix 
1). The inner product is the sum of the products of corres- 
ponding elements. 

For example, 

Up”? F иззиЗ3-- 144424 

= (— 53:963 X 42:272 + 163073 X 75:952 — 39:663 

X 2:638) x 10 * — 1:000 

маз СЬ иззиЗї F изиїї 1 

= (— 53:963 X 24:960 — 163075 X 2638 + 39663 

X 44:804) X 1073 = 0-000 
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369174 
We next find C = U,,3U,,— | :140860 |. These figures 
“130131 : 
are obtained by forming the inner product of successive rows 
of U p" with U,,. Thus 
-369174 = (146089 X 49:315 — 42:272 X 48-054 
— 24:960 X 59:347) X їо-4 


and -140860 = (— 42:272 X 49:315 + 75:952 X 48:054 
‚ — $638 X 59:347) X 10 3. 


The elements in C are the regression coefficients for raw 
8СОГ68, 201», 9,5 and тоу, referred to on pages 29 and 34. 


There we noted that CT di -36917 


. agreeing with the value in C. 


The next move is to find D — U,,— баб: 


:369174 
ОС = [49'315 48054. 59:347] Х| -140860 
*13013I 


Forming the inner product of row and column as before, 
С.С = 32-698, whence D = 126-180 — 32:698 = 93:482. 


Finally we have to evaluate C'P,,C. The values of all the 
elements in E pp аге known, viz. : 


225:00 292883 314175 
Т.» =| 297883 549434 466677 
314:175 466677 670:292 
For example, 292-883 = Х,У,Ёдл, and 670292 = 5,2 
Forming the inner product of successive rows of V pp with C. 


165-204 | . Thus 165-204 —2,25:000 X 
we have Ppp =| 246-247 369174 + 292:883 х -140860 
268-947 + 314175 X 130131. 
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165:204. 
Then C'(,,C) = [369174 140860 130 131] X | 246-247 
: 268:947 
— 130674 E 
and D + СУС (= Га) = 934824 130:674 = 224/156. 


We are now in a position to give values to all elements inthe 
variance matrix, Г, for the population. The matrix is 


Xi Xo Ха X4 
224/1156 165-204 246247 268:947 [хі 
Ee 165-204 225:000 292883 314175 da 
246247 292883 549434 466677 [аз 
268047 — 314175 466677 670202 [га 


We have immediately, element туу = X3? = 224156 
or Dy = 14:972. 


Uis Zuza )- 165204 0. 
Also Ris WES (Gas Xm)  4/224°156 X 225-000 
= 57350 
Similarly R43 = 7017 


R34 = 6938 


Regression coefficients for standard scores applying to the 
population are obtained from 25, 2013 and #44, the elements in 
matrix C, thus : 


XE 15:00 
Вуз = M12 X Er "369174 X Sa = +3699 
s 23: 
Вуз = was X 5 -140860 х Цэ: = 2205 
25:8 
Віза X == 120131 X E “2250 


These regression coefficients are checked by the method 
given at the end of Appendix 1: 6-8-5 
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Bis BygRog + By Rs, = :3699 + :2205 X -833 + -2250 
X 4809 = -7356, agreeing with the ascertained value of Ж... 


The Multiple Correlation of the criterion with the three 
independent variables in the population is given by 


Per "3699 X +7356 + -2го5 X err + -2250 x -6938 
= 1582928, whence R,.,44, = “7635. 1 


тг 


EE ` 


APPENDIX III 


Tue CALCULATION or THE RECIPROCAL ОЕ А MATRIX BY 
Prvorat Conpensation (Аіткех'з METHOD) 


We demonstrate with the matrix U,, in Appendix 2. Аз 
this matrix is of order 3 х 3, that is, has but three columns and 
three rows, it is. much shorter to find its reciprocal by the 
method given in Appendix 2 ; the method of pivotal condensa- 
tion, however, is more convenient for matrices of higher order. 

The working is now given: (р. 56), and the explanation 
of the method follows. A 2 


Explanation оў Working 

1. The matrix is first written down as shown to the left of 
rows 1, 3 and 4. Row 2 is for the moment left blank. The 
matrix is bordered by three matrices ; immediately below by a 
matrix of the same order (in our case 3 X 3) with unity in each 
diagonal position and zero elsewhere (the dots represent 
zero); to the right by a matrix of the same order with — r in 
each diagonal position and zero elsewhere; to the bottom 
right by a matrix of the same order with zero elements 
throughout. In the check column is entered the sum of the 
elements in each row. 

2. The top left figure of the matrix, 93-509, is called the 
pivot. The first move is to divide all elements in row 1 by 
the pivot; this is more easily done by multiplying each by the 
reciprocal of the pivot, which is shown as +0106942 to the left 
of the matrix. The products of the reciprocal are written in 
row 2 which was left blank for this purpose. (When the 
reciprocal of a matrix of correlation coefficients with unities 
as diagonal elements has to be found, this process is, of course, 
omitted since the pivot itself is unity) The sum of the 
elements in row 2, 2:157465, is then written in the check 
column, and checked against 201-742 X -0106942. 

3. The process of condensation now begins. The first row 
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124100. togttoo. g£9z000. — одбігоо. — b 
zbor£oo. 892000. — 206400. zLzztoo. —| 
9559400. og6*zoo. — zZzztoo. — GORO d 
000.1 . 2 2 1 
199660. — а 4645400. 1tZEtoo. —! Є/96С0. — 
брас. — : 1kZtroo. — £g1z£10. 860266.-- « 
622866. Foghkoo. — 44692000. 096¢z00. I 
1190021 1-2 Єйввсо. 60455. БИН 27446 4-4) 6£ogttoo E 
a de EO чы 
000.1 : : E 1 : | ZE 
000-1 , ` = 5 5 1 
SgrZ61.1— 2 * — t69oro. 890165. — 160445. — 
OIO.IfC 1— х 90165. 29.622 249444 
999860.1 З 4646400. — rtZttoo. Е/8860- І 
E ат арат аран” арна e ана аа 646400 
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of Slab 2, that is row 8, is obtained from rows 2 and 3 of Slab 1 
as follows : 
131-931 = I X 163073 — 53:963 X "577091 
77672 =1 X 39:663— 53:963 X “501068 
“57708 — 1 x о — 55:963 X — -o10694, and so on. 
The entry in the check column of row 8 is obtained in the 
same way, viz. 139:275 = I X 255:699 — 53:963 X 2:157465. 
'The sum of the elements to the left of the check column must 
be equal to 139:275 if the arithmetic is correct. Error of a 
few units in the last significant figure is, of course, permissible 
when arithmetical approximations have been made. In such 
cases it is advisable to write in the check column the sum of 
the elements in the row rather than the difference of products. 


4. Row 9 may now be completed by dividing each of the 
elements in row 8 by the pivot 131:931, or multiplying by 
100757972. . 

The remaining rows of Slab 2 are found from pairs of rows in 
Slab 1 as was row 8. Row 10, for example, is derived from 
rows 2 and 4, row 11 from rows 2 and 5, etc. Thus, 223:652 
in row Io is obtained from І X 256:320 — 55:270 X 591068. 
Note that two elements in row 2 always figure in the calcula- 
tion for each element of Slab 2. 

5. When Slab 2 is completed, the elements of Slab 3 are 
computed from Slab 2 in the same way, row 14 being derived 
from rows 9 and 10, row 16 from rows 9 and ІІ, and so 
on. Thus, 0132183 in row 16 is derived from 1 X -o10694 
— (— :577091 X :0043741). 

6. The process of condensation is continued until no figures 
remain in the left-hand block under the original matrix. The 
3 X 3 matrix to the left of the check column of Slab 4 is the 
desired reciprocal matrix. It is the same as found by the 
shorter method in Appendix 2. 

7. The number of condensations to be made will be equal 
to the number of columns in the original matrix. The 
condensation of a matrix of correlation coefficients is of 
frequent occurrence for the calculation of regression coeffici- 
ents; it'is somewhat less tedious than that of the present 
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matrix of covariances since the position of the decimal points 
is easier to locate. In general it is advisable to retain from 
four to six significant figures according to the accuracy of the 
elements in the original matrix. 

8. Although each row of the computation is checked by the 
figure in the check column, a further check can be made as 
described at the end of Appendix 1. 
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